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Randomized Benchmarking allows to efficiently and scalably characterize the average error of an 
unitary 2-design such as the Clifford group C on a physical candidate for quantum computation, as 
long as there are no non-computational leakage levels in the system. We investigate the effect of 
leakage errors on Randomized Benchmarking induced from an additional level per physical qubit 
and provide a modified protocol that allows to derive reliable estimates for the error per gate in their 
presence. We assess the variance of the sequence fidelity corresponding to the number of random 
sequences needed for valid fidelity estimation. Our protocol allows for gate dependent error channels 
without being restricted to perturbations. We show that our protocol is compatible with Interleaved 
Randomized Benchmarking and expand to benchmarking of arbitrary gates. This setting is relevant 
for superconducting transmon qubits, among other systems. 


I. INDRODUCTION 

In the wake of recent advances in experimental im¬ 
plementations of quantum gates on physical qubits [1- 
3], characterizing the fidelity of those gates efficiently 
and accurately becomes increasingly important. The 
original standard approach to achieving this is quantum 
process tomography (QPT) [4] which is not reliable as 
it cannot discriminate gate errors from those of state 
preparation and measurement (SPAM) [5]. Neither is 
it practical due to the number of measurements needed, 
which is exponential in the number of subsystems. The 
Randomized Benchmarking (RB) protocol is a scalable 
and SPAM independent method to benchmark unitary 
2-designs such as Clifford gates by characterizing the fi¬ 
delity of sequences of random gates [5, 6]. Interleaved 
Randomized Benchmarking (IRB) provides a means to 
estimate the average fidelity of a single gate of the group 
up to a uncertainty defined by the group fidelity [7]. As 
the RB protocol is used not only for benchmarking but 
for closing the loop in experiment optimal control [8, 9] 
it becomes increasingly imperative for all possible errors 
connected to this protocol. 

Many promising candidates for implementing qubits 
on which RB is applied such as superconducting qubits 
[I, 10], NV-centers [11], trapped ions [5] or neutral atoms 
[12] are not natural two level systems making leakage into 
additional levels a viable error source. Since the physi¬ 
cal qubit is protected from unwanted interactions with 
the environment so are in many cases the leakage levels. 
Therefore leakage is not accounted for by standard RB, 
not least because it is a non-Markovian process. Further¬ 
more standard RB treats gate dependencies only in the 
regime of small deviations from a predominant gate in¬ 
dependent error. We investigate leakage arising from an 
additional level per qubit as first discussed by Epstein et 
al. [13] in the single qubit case. We provide a generaliza¬ 
tion of their RB protocol accounting for leakage errors 
as well as strongly gate dependent error channels. We 
investigate the number of random sequences needed for 
a good estimate of the fidelity and show that IRB still 
works-even for gates not in the unitary 2-design. 


This work is structured in the following way. We in¬ 
troduce the protocol in section II and derive the associ¬ 
ated fidelity model in section III. There, we first make an 
additional assumption on the Clifford gates and discuss 
in III A how useful information can be extracted even if 
these are not satisfied. In sec. IIIB we discuss the influ¬ 
ence of SPAM errors. Gate dependent errors are treated 
in section V and section VI covers IRB. 


II. MODIFIED PROTOCOL 

The RB protocol allows to efficiently estimate the av¬ 
erage fidelity of a unitary 2-design like the N-qubit Clif¬ 
ford group Cat, i.e., find the average fidelity of all Clifford 
gates. For that one applies a sequence of y random gates 
and then inverts them with a final gate. The final gate 
can be easily calculated on a classical computer according 
to the Gottesmann-Knill theorem [14]. It can be shown 
that the resulting quantum channel approaches the y- 
fold application of a depolarizing error channels [5, 6, 15] 
and can be fitted to an exponential decay in y. A major 
consequence of the application of RB sequences is that 
there is no coherent interference between errors meaning 
here that the error channel does not maintain any well- 
defined phase relations between different states. This is 
not the case if one considers transitions to a third, non- 
computational level in any physical qubit while still only 
applying qubit Clifford gates. For a single qubit, Epstein 
et al. proposed the simple procedure of randomly in¬ 
serting phase factors ±1 on the third level to reach the 
required phase randomization [13]. The multi-qubit gen¬ 
eralization is to randomly insert these phase factors on 
every qubit independently, thus destroying any phase re¬ 
lation. Including these operations extends the Clifford 
group C into the altered Clifford set C* 

=Cjv X (1) 

whose size is increased by a factor of 2^ for N physical 
qubits used in our RB protocol, and Cn is the Clifford 
group for the corresponding N qubits. It is not necessar¬ 
ily a group since the effect of every implemented gate on 
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the non-computational subspace can be arbitrary. There¬ 
fore C* does not have to be closed or contain an inverse 
or even neutral element. As will be derived in section III 
the parameterized fidelity one needs to fit is 

= (2) 

i 

with \i eigenvalues of an operator related to the error and 
the Oi define the measurement functional in its eigenbasis, 
they contain the SPAM errors as one contribution. At 
least a single Xi is unity and the number of different is 
smaller than 3^. The obtained average fidelity then sums 
up to the average error of applying a 

single gate. 


III. DERIVING THE FIDELITY MODEL 


In this section, we derive a model for the error per gate, 
neglecting state preparation and measurement errors as 
well as the error of the inverting gate for simplicity. The 
effect of this approximation will be discussed in IIIB. 
Adding a phase factor on the leakage level as required 
in the previous section is practically straightforward, for 
example by waiting the appropriate an amount of time. 
This time is set through the qutrit anharmonicity Suj, 
i.e., the difference in Bohr frequency between the leakage 
transition and the working transition, as r = 0/ha; to 
achieve a phase 4>- This extends easily to multiple qubits 
if these are frequency-tunable [16]. Using this extended 
Clifford set C* of equation (1) removes all phase relation 
between different energy levels, thus, following the same 
reasoning as in other discussions of RB such as Ref. [13] 
all resulting density matrices are diagonal, given by 


r /l 0 0\ /O 0 0\ /O 0 0\ ] 

= N 0 0 0 , 0 1 0 , 0 0 0 i . (3) 

[ \o 0 oy \o 0 0/ \o 0 1/ J 


Using the Frobenius inner product {pi\p2) = Tr[/5|p2] 
and representing diagonal density matrices as vectors and 
superoperators as matrices the measured fidelity of the 
RB protocol for gate independent error channel A is 


1 1 

‘^y = ^ E {p^\Cy+,\{(kC,)\p,) (4) 

{Cj}&C*y j=y 

1 ^ 

= ^ E {po\Cy+^l[iAC,)C2C^x 

{CUgC*« j=y 

X C^^C2^AC2Ci Cf^ACi Ipo) • (5) 

U denotes the cardinality and neither the elements of 
C* nor error channels are unitary in this representation. 
The product indices are counted down in order to ensure 
that the lower index random Cliffords Cj are applied first. 


For the standard RB restricted to the computational sub¬ 
space the group properties of C yield that 

E/(C2Ci) = E/(C2) (6) 

C2 C2 


for any Ci G C and any function /. Including a third 
level any unitary operation is no longer fully determined 
by its effect on the computational subspace but by the 
3N — 2^ dimensional non computational subspace as well. 
Since any gate is engineered with respect to how it acts 
on the first the effect on the latter may be arbitrary as 
long as the subspaces are kept disconnected. Thus, in 
general, the set C* is not be a group since it is neither 
closed nor does it contain inverse or neutral elements a 
priori. As equation (6) relies on the group property it is 
therefore no longer valid for general C* rendering a twirl 
over A no longer possible. We will solve this problem in 
section III A. 

A gate on a qutrit is considered to be a perfect single 
qubit gate if it has perfect gate fidelity in the qubit sub¬ 
space and leaves a phase shift on the leakage level [17]. 
Since the random phase shifts randomize that phase we 
can effectively treat every single qubit gate as if it would 
act as the identity on the leakage level and the single 
qubit Clifford set Cl as if were a group in the sense that 
after the randomization, group properties are recovered 
within the RB protocol. 

This argument does not hold in the same form for more 
than a single qubit. On the other hand, the multi-qubit 
Clifford set is generated by its single qubit generators 
plus at least one entangling Clifford gate between arbi¬ 
trary qubits. If one presumes that the entangling gate 
induces a mere phase change on the leakage levels as well 
- which is equivalent to it being diagonal in the non com¬ 
putational subspace - then this means the whole Clifford 
set has this same property. As above, since phases are av¬ 
eraged to zero by their randomization the set of Clifford 
gates can be treated as a group as for further calcula¬ 
tions. In the following we call such a set a twirl design 
and it yields a fidelity of 

1 1 

= E (poinc'7'AQIpo) (7) 

{Cj}eC*y j=v 

= (Poj Ipo) • (8) 

The matrix Atwiri representing the error channel A 
twirled over C* now acting solely on 'Hd has only real non¬ 
negative entries since they represent the transition from 
one level to another. The Perron-Frobenius theorem of 
linear algebra [18-20] states that such a matrix always 
has a unique highest eigenvalue with positive eigenvector 
under the condition that all entries are nonzero which is 
clearly given for any real quantum channel. This eigen¬ 
vector represents the state the system converges to for 
increasing sequence length y, irrespective of the initial 
state, and the single unique highest eigenvalue has to 
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be one. Another fundamental property of any A in this 
eigenbasis is that every column sums up to one due to 
trace preservation. Here, the trace of a vector means the 
sum of its vector entries as each basis vector represents 
a density matrix with unit trace. 

Atwiri can be assumed to be diagonalizable in all cases 
besides a set with vanishing Haar measure; its eigen¬ 
vectors Xi, on the other hand, are not restricted to be 
real for more than one qubit as the resulting channel is 
no longer guaranteed to be depolarizing. To investigate 
conditions for real eigenvalues we first consider a chan¬ 
nel A on Tid resulting of a small unitary error. We write 
U = exp(—zAff) as an exponential of a Hermitian op¬ 
erator with A||iJ|| ^ 1 and expand the resulting A in 
orders of a small parameter A. Since the zeroth order of 
the expansion is the identity and the first order vanishes 
by construction the leading order matrix elements to be 
investigated are of second order in A, 


Ag) = A^Tr 


= A2|(z|iI|j)P=Ag). 


(9) 


A is thus Hermitian up to second order ensuring real 
eigenvalues A^. Third order terms have small effects 
on the characteristic polynomial and of A and complex 
eigenvalues can only occur if the second order eigenvalues 
are degenerate or very close to each other. For a most 
general A one has to consider an unitary on the system 
combined with an environment {|i?fc)} [4]. 


Ag)=A2^|(z,Afe|i7|j,F;o)p (10) 

k 


space, whereas our work shows that such control is not 
required for extracting the hdelity alone. 

Fitting a multi-exponential decay with complex decay 
parameters Xi may pose a problem since oscillations in 
as they are overlapping with each other and the natu¬ 
ral fluctuations, can be hard to fit especially when small. 
To make a safe estimation of the maximum average gate 
error one has to consider that oscillations in fidelity are 
population coming back into the initial state. Since we 
twirl over the computational subspace the maximum fac¬ 
tor for repopulating this state is ^ so the fitted ac¬ 
knowledges at least a fraction of 1 — 2 ~^ of the actual 
error. 


A. RB of Clifford sets that are not twirl designs 

The assumption made in earlier this section when in¬ 
troducing the twirl design that the entangling gate or 
gates are diagonal on the non computational subspace 
does not apply to all physical systems. This assump¬ 
tion was necessary to make sure the randomized Clifford 
set closes like a group hence forming a twirl design. For 
example considering a CNOT on the computational sub¬ 
space also performing a NOT on the target if the control 
qubit is in |2). Omitting this assumption thus enforces 
to reconsider equation (4) where Cy+i is no longer the 
inverse of all previous Clifford gates as the dynamics in¬ 
side the non-computational space are not accounted for 
and may be non-Clifford. Because we are only measuring 
within the computational subspace - up to measurement 
error that we neglect as it contributes to SPAM - we can 
calculate as it were 


Only one summand, fc = 0, is guaranteed to be invariant 
under exchange of i and j, the rest are arbitrary and can 
therefore in principle yield eigenvalues Xi which have a 
non-negligible imaginary part. It needs to be noted that 
this is not very common as these terms are typically close 
to Hermitian operators, as is also confirmed numerically. 
In any case Aj^jj.j is an element of the Hilbert space of 
linear operators on and of equation (8) is a linear 
functional of that, therefore 

<^y = J2aiXy ( 11 ) 

i 

with constants defining the functional in the eigenbasis 
of Atwiri- Note that this is the same form as equation (2). 
Unlike the single qubit case [13] for multiple qubits not 
all errors channels have the same eigenbasis so the fit 
parameters do not reveal all channel properties of the 
twirled error. Luckily one does not need to know the 
exact form of A but can simply fit the measured fidelity 
to the above fit model. In the same way it is possible to 
measure the population of the computational subspace 
within the same model to characterize the total leakage 
rate of an error channel. This has been studied Ref. 
in [21] under the assumption of control over the leakage 


= ^ E (po\ n(AC',)ACi \po ). 

^ {CHec*» j=v 

( 12 ) 

With CiCy+i being the inverse of all Cliffords but the 
first, one can see that applying one more random Clifford 
gate in the sequence means multiplying from the left 
and ACi from the right averaged over all Ci in C*. Thus, 
extending the length of the sequence by one gate defines a 
linear and positive map T\ on the Hilbert space of linear 
operators on Hd- The resulting hdelity 

$, = (po|r?(i)|po) (13) 

as a linear functional of a matrix exponential is again 

i 

There are vanishing entries due to the fact that the Clif¬ 
ford set does not connect all states in particular it does 
not connect leakage and computational subspace. Ac¬ 
cording to the Perron-Frobenius theorem the highest 
eigenvalue does no longer have to be unique but the mod¬ 
uli of all eigenvalues are still bound by one. This implies 
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that there might no longer be a uniform limit to which 
all elements of Tid converge for large y. It is but true that 
the protocol is still invariant under changing the initial 
state in the computational subspace, so only accounting 
for real eigenvalues produces a factor of 1 — which 
vanishes for long sequences. 

Figure 1 compares the RB protocol for examples of 
Clifford sets which are or are not twirl designs for a uni¬ 
tary error which as the channel most affected by twirling 
and therefore has been considered the errors most diffi¬ 
cult to estimate with RB in previous publications. How¬ 
ever the actual difference in average fidelity is small. This 
is due to the fact that the twirl on the computational sub¬ 
space is intact and that the Clifford set is not changed 
much by shifting of one of its elements. 

We produce a random unitary error by applying a ran¬ 
dom unitary basis transformation to the exponential of 
a small diagonal Hermitian. For arbitrary error channels 
we apply such a unitary to the system plus an environ¬ 
ment which we then trace out. 



FIG. 1. Average fidelity for a unitary error of 1.354 x 10“^ 
for 40 different random sequences per sequence length y. The 
blue points are simulated data for a twirl design whilst the 
Clifford set used to generate the red points is none. The twirl 
design estimates an error of 1.379 x 10“® and the other 1.350 x 
10~^. Both 2-qubit Clifford sets are generated from the single 
qubit Clifford sets and few 2-qubit entangling gates [22] which 
do or do not satisfy the conditions for a twirl design. The 
obtained average sequence fidelities are fitted to the multi 
exponential decay function and the error rates are calculated 
via equation (16). 


B. State Preparation and Measurement Errors — 
SPAM 

In all the above calculations we neglect SPAM errors. 
We show in this subsection that this is justified and that 
SPAM errors have in fact very little influence on our RB 
protocol and can moreover, as in other RB protocols, be 
isolated as they do not depend on the sequence length y 
thus giving an offset of the fidelity curve. For twirl de¬ 
signs, none of the calculations assume that one prepares 


and measures states in the computational subspace. Due 
to the phase randomization SPAM errors can be assumed 
to act on l-Ld leading to the following fidelity of the full 
experiment, 


= {po\ AmAA^^j^jAp \po) 

(15) 

Here, the second line defines the actually prepared state 
Pp, a,s well as an effective measured state pM- As this is 
once again a linear functional of a matrix exponential the 
model stays intact. One can think of the actual average 
fidelity of a single random Clifford as the factor by which 
the highest possible effective fidelity decreases due to its 
application. Said fidelity is determined by SPAM errors 
leading to an average fidelity of the Clifford set 

(j) — (PAf I Atwirl \Pp) _ ^ 

{pm\pp) ‘ho 

The assumption that for Clifford sets which are not twirl 
designs the last gate Cy+i can be considered the inverse 
of all previous ones is only true in the computational 
subspace, because the full operations are not necessarily 
Clifford. The error made by that is calculated by first 
splitting up the effective measured state into computa¬ 
tional and non-computational parts 


(E> = 


1 


E 

{CHec*« 


{pM\Cy + ,\{{KC,)\pp) 

3=V 


1 


E 


(PMicomp C'y+1 nCACj) \pp) 
j^y 


+ (PMlieak C'y-l-1 

j=y 


For the computational subspace Cy+i can now be re¬ 
placed by the actual inverse. 


= UCW E (PMlcomp^y ^ 

^ {CH6C*« [ j=V 

1 

+ {pm\ leak n ipp)co„.p 

j-y+i 

1 

+ (PMlieak C'y-kl l[(^C,)\pp) 

leak 

j^y 

= (PMlcomp^A(l) \PP) 

+ (PMlieak^A(l) l7'P)comp + 0{ep{£M + s))- (17) 

The e are state preparation, measurement and gate error 
rates and hence the deviation from the model is negligibly 
small and not scaling with y leading to the same fidelity 
arguments as before. 
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IV. VARIANCE OF THE FIDELITY 


The number of possible choices for y random Clifford 
gates is (ttCjv 2^)^ where the cardinality of the Clifford 
group has a lower bound exponential in N. With that 
background it is remarkable how few different realizations 
of sequences are typically needed to obtain a reliable re¬ 
sult. We therefore investigate the variance of the fidelity 
with respect to these possible choices up to second/third 
order for twirl designs. (Although all error are considered 
the same they are perturbed by A = Atwiri + CA in both 
factors of the squared term as well as after every gate 
individually.) The raw channel A is close to Atwiri but 
has an error due to the limited number of sequences, and 
therefore can be written as A = Atwiri + CA with a small 
operator ca- Sorting by order of this ca and omitting 
higher orders one gets 

[<l> 2 ]c. = + 

^ i ^ (pol . ( 18 ) 

" x=lD(^C* 


Note that the above is second order since every twirl 
over an ca has to vanish. Also all second order terms 
with perturbations on different errors are zero as well 
as those of every odd order because single deviation al¬ 
ways twirls to zero. Furthermore one needs to take into 
account that the errors ea as the difference between an 
operator on T-Ld and one on density matrices in general 
is not per se an operator on T-Ld but rather acts on the 
space of density operators. Since for the second order 
terms there is only one ea in each po bracket it can be 
just as well projected onto such. For further calculations 
we change to the eigenbasis of the twirled error and ab¬ 
breviate e{D) = D'^eaD. We can thus work out the RHS 
of equation (18). 


V 


E {po\K^-^,D^^ADAy-.:,\poy 


ttc 


x—1 D^C* 
1 ^ 


i: 


x — 1 D^C* Si,S2,S3,S4 

\y—x\x—l^ 


1 y 

= ^ E E 

^ £l.{s}a:=l 


— X 
S4 


7{s} 


As 2 -^^4 


Asi Agg 


iD)siS2^iD)s3S4, (19) 


Evaluating the geometric sum leaves us with 





1^S1S2^S3S4- 


( 20 ) 


Equation (20) always has an upper bound by an ex¬ 



Sequence Length y 


FIG. 2. Variance with respect to possible combinations of 
Clifford gates for an relatively small error (7.42 x 10“'*) - 
averaged over a total of 30 different sequences 


ponential decay times y, 7 is smaller or in the order of 
magnitude than/of one and the Es are comparable to sin¬ 
gle gate errors. For simplicity (and consistent with our 
numerics these terms are mostly bigger than others for 
random errors) we now assume that si = S 2 and S 3 = S 4 
and continue on equation (19) 


([$]?. 




= 'y{s}y- 


.{Xs^ 

Asi As 3 


E E 

r^SiSiJ^S3S3 


oc ye 


-Ky 


( 21 ) 

( 22 ) 


This explains the behavior observed in the simulation 
conducted for figure 2. For si = 1 or S 3 = 1 which 
corresponds to changes of the state with A = 1 the E 
terms vanish since this state is preserved for all quantum 
channels. Therefore there will always be an exponential 
decay. The order of this estimates is the same as that for 
standard RB [23]. 


V. GATE DEPENDENT ERRORS 


The RB protocol analyzed so far assumes A to be in¬ 
dependent of the preceding gate or more specifically uses 
an effective gate error. Magesan et al. investigated first 
order corrections to that assumption for the leakage free 
case yielding an altered fidelity model under the condi¬ 
tion ||A — Ajljy ^ 1 with gate dependent error channels 
Aj [ 6 ]. Having more degrees of freedom for these error 
channels Aj this issue becomes even more important for 
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the leakage case. Neglecting SPAM we get 

1 


= 


1 


V 

1 

1 


r 


*y 


E 

(Po Ay + lCy + l jj(AjC'j) 

{cUgc*« 


j^y 

E 

(po ACy+l 

1 

\po) 

{C,}GC-« 


j^y 

E 

(poiAcr^ 

ClCy+l X 




X 

2 

n(A,C'^) 

> 

o 


j=y 


Up to an additional error of the order of || A — Aj ||?/ <C 1 
which is overall and not per gate, the expansion by one 
random Clifford is a linear operation on the operators on 
TLd hence 


(PolT^(l)lpo) 

(24) 


(25) 


I 


This shows that is it not necessary to alter the protocol 
for gate dependent errors; however there a two aspects 
which need to be considered. 

First the phase randomization is no longer considered 
perfect leading to transitions to non diagonal density ma¬ 
trices. This has the potential of blowing up the dimension 
of T (3 up by a factor of 3^^ resulting in more and likely 
complex eigenvalues but as second order terms of single 
qubit errors these effects can be considered small with 
respect to the average error. In the practical application 
one needs to consider how many different are needed to 
properly describe the y dependence of the fidelity. One 
can see that the number of different Ti is the order up to 
which deviation from an effective r are completely cov¬ 
ered. Magesan et al. discussed conditions for neglecting 
higher order terms when they derived a first order pro¬ 
tocol for gate dependent errors without leakage [6]. As 
our calculation still holds without leakage errors one can 
show how their model coincides with ours in the limit 
of sufhciently weak gate dependencies while we are not 
restricted to this regimes. 

Second we have to note that is no longer completely 
independent of the initial state which is necessary for con¬ 
sidering only real eigenvalues and counteracts the idea of 
RB itself. It however can be fixed by an approximation 
making a single error of the order of ||A — Aj|j 

= (Po\C-^Ty-\l)AC \po ). (26) 

^ cgc* 

This means that the protocol is independent of the initial 
as well as the measured state up to a very small error. 
This aspect is crucial for that fitting to real eigenvalues 
accounts for at least I — 2~^ of the actual error. The 
gate dependent error channels produce a fundamentally 


different error associated matrix T than in the gate in¬ 
dependent case so one can no longer argue that all real 
eigenvalues are likely, regardless of the use of the phase 
randomizing Clifford set C*. 


VI. INTERLEAVED RANDOMIZED 
BENCHMARKING 

The RB protocol is designed to identify the average 
performance of a unitary 2-design such as the Clifford 
group; the fidelity of an individual element V thereof can 
be estimated by Interleaved Randomized Benchmarking 
(IRB) [7] . The main idea is to alternate random Clifford 
gates with gate of interest to obtain a combined fidelity. 
Applied to our framework one obtains 

1 1 

Ay+lCy+l Y[iVAyA,C,)\po) 

{Cj}ec*y j=y 

= ^ E (polAcrV-iyCiC.+i X 

^ {Cj}GC*y 
2 

X l[{VAyA^C,)VAvA^Ci\po) . (27) 

j=y 

VCiCy+i is the inverse of the gate sequence without VCi 
and therefore adding a random gate plus the gate in ques¬ 
tion is once again a linear operation which results in the 
same fit model 


$, = (po|T^(l)|po) (28) 

= ^dirjf- (29) 

i 

The resulting fidelity 

E {Po\C-W-^VAyAcC\po) 

^ cec* 

= ^ T. (Po\<^~'^v^cC\po) (30) 

^ cgc* 

shows the average combined error of V and the Clifford 
set. Assuming those are small the estimated error rate of 
V can be calculated as Sy = Sc*xV ~ ^C* and lies within 
the bounds 

{\/£c*xv — < £v < {y'£c*xv + V^) ■ (31) 

The only point where we used that V is in C* is that 
the inverting gate at the end of the sequence can be im¬ 
plemented sufficiently accurately. This means that its 
error has to be small with respect to the sequence errors 
but can easily be of an order of magnitude higher than 
the gate error because it is independent of the sequence 
length. This is comparable to the influence of SPAM er¬ 
rors. Under above assumption the IRB protocol holds 
for every unitary operation which is shown in figure 3. 
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FIG. 3. Interleaved Randomized Benchmarking for an uni¬ 
tary operation on SU (4) not element of a twirl design with a 
gate independent error of 7.57 x (blue). The interleaved 
protocol yields a combined error of 1.304 x 10“^ estimating 
the gate of interest at 5.50 x 10“'* when its actual error is 
5.44 X 10“*. This is a very good estimate considering the 
range of IRB. 

VII. CONCLUSION 

We have investigated the effect of leakage errors on RB 
and, to account for those, provided an alternated proto¬ 


col using a phase randomizing Clifford set and a multi¬ 
exponential decay fit function. We introduced conditions 
under which the twirl of the error channel over the Clif¬ 
ford set is preserved but also showed that our protocol 
applies regardless of this. Although we only considered 
one additional level out work is easily expendable to mul¬ 
tiple leakage levels. Our protocol accounts for arbitrary 
gate dependent error channels, even if they are not small 
perturbations. We showed that our protocol is compati¬ 
ble with IRB and that this even holds for gates that are 
not element of the underlying unitary 2-design. 
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